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Abstract 

Entropy production along a single stochastic trajectory of a biomolecule is discussed for two 
different sources of non-equilibrium. For a molecule manipulated mechanically by an AFM or an 
optical tweezer, entropy production (or annihilation) occurs in the molecular conformation proper 
or in the surrounding medium. Within a Langevin dynamics, a unique identification of these two 
contributions is possible. The total entropy change obeys an integral fluctuation theorem and a 
class of further exact relations, which we prove for arbitrarily coupled slow degrees of freedom 
including hydrodynamic interactions. These theoretical results can therefore also be applied to 
driven colloidal systems. For transitions between different internal conformations of a biomolecule 
involving unbalanced chemical reactions, we provide a thermodynamically consistent formulation 
and identify again the two sources of entropy production, which obey similar exact relations. We 
clarify the particular role degenerate states have in such a description. 

PACS numbers: 

05. 40. -a Fluctuation phenomena, random processes, noise, and Brownian motion, 
05. 70. -a Thermodynamics, 

82.39.-k Chemical kinetics in biological systems, 
87.15.-v Biomolecules: structure and physical properties 



I. INTRODUCTION 



Biological systems are generically out of equilibrium. Still, for most processes in cell 
biology taking place on the level of a single (or few) molecules, the intracellular aque- 
ous solution provides an environment with constant temperature. The genuine source of 
non-equilibrium are not temperature gradients but rather mechanical or chemical stimuli 
provided by external forces or imbalanced chemical reactions. Such a characterization moti- 
vates the quest for a thermodynamical understanding of mechanically or chemically driven 
non-equilibrium processes taking into account their necessarily stochastic character on the 
level of few molecules [1] . Crucial for such a program are consistent formulations of the first 
and the second law under these conditions. 

For mechanically driven processes, the controlled unfolding of proteins, RNA, and DNA 
typically described by Langevin equations can serve as a paradigm (for a review, see Ref. [2]). 
For the overdamped motion of a single colloidal degree of freedom, Sekimoto has shown how 
to relate work, internal energy and exchanged heat with the terms occurring in the Langevin 
equation, thus providing a formulation of the first law on the level of a single trajectory [3]. 
The extension of this interpretation to a biomolecule with several overdamped spatial degrees 
of freedom subject to both a potential of mean force and some additional mechanical force 
applied via an AFM or optical tweezers is, in principle, straightforward and will be given 
below. As a refinement of the second law, the Jarzynski relation expresses the free energy 
difference of an initial (folded) and a final (unfolded) state by an exponential average of 
the non-equilibrium work spent in such a transition [4-7]. This relation has found wide- 
spread attention both in experimental and theoretical studies of unzipping and unfolding 
transitions [8-13]. It has also inspired theoretical studies on the probability distribution 
of the work spent in such processes [14-16]. Even though the Jarzynski relation does not 
explicitly require a definition of entropy on the level of a single trajectory, one obtains a 
second-law like inequality for the average work as a mathematical consequence. The concept 
of an entropy of a single trajectory is fruitful since it allows to derive equalities different 
from but related to the Jarzynski relation for the total entropy change directly [17]. 

For chemically driven processes, an equally comprehensive understanding and formulation 
is not yet available. Based on classical work on network thermodynamics [18-21], ensem- 
ble properties like mean heat dissipation or entropy production rate have been identified 
and investigated (see [22-25] and references therein) with only a few attempts to provide a 
thermodynamic interpretation of the single reaction events [26, 27]. Taking the Langevin 
equation for mechanically driven processes as a guideline, however, it should be possible to 
formulate for single biochemical reaction events a first-law like energy conservation state- 
ment. Likewise, for a proper formulation and refinement of the second law, one should 
develop a notion of entropy along such a single stochastic history of reaction events. Only 
after averaging one will then recover previous ensemble formulations. The motivation for 
such a trajectory-based approach also derives from the exciting experimental possibilities to 
study conformational changes of single enzymes using fluorescence spectroscopy as reviewed 
in Refs. [28, 29]. Finally, molecular motors comprise a class of systems where biochemical 
reactions lead to discrete mechanical steps for which such a thermodynamic modeling should 
become appropriate as well [30-37]. 

This paper presents a coherent theoretical framework for describing both mechani- 
cally or chemically driven transitions between different configurational internal states of 
a biomolecule in a way that is thermodynamically consistent on the level of a single tra- 
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jectory. In particular, concerning entropy production, we exploit the general framework 
introduced in Ref. [17] for such isothermal non-equilibrium processes. In Section II, we con- 
sider the mechanically driven dynamics of a biomolecule involving several (slow) degrees of 
freedom. We provide a first law-like interpretation of the Langevin equation for its coupled 
overdamped degrees of freedom and derive exact relations on entropy production along such 
a driven trajectory, thereby extending our previous work both to many degrees of freedom 
and to (long-range) hydrodynamic interactions among them. Such interactions will become 
particularly relevant for colloidal systems (to which the same formalism is applicable) if 
extant studies of their non-equilibrium thermodynamics [38-44] are pushed beyond the one 
particle level. In Section III, we first consider transitions between different internal states of 
a protein or enzyme caused by biochemical reactions involving unbalanced chemical species 
which are the source of non-equilibrium in this case. We then apply the general notion of 
entropy production introduced in Ref. [17] to such transitions and derive exact relations for 
the total entropy production. Finally, we discuss the modifications arising from a possible 
degeneracy of the states occurring in such a description. In Section IV, we discuss a few 
perspectives of our approach. The Appendix contains the path-integral based proof of a 
general integral fluctuation theorem for (hydro) dynamically coupled degrees of freedom in 
a time-dependent potential. 



II. MECHANICALLY DRIVEN CASE 

We describe the biomolecule by a set x = (x\, . . . ,Xd) of internal coordinates, which 
should comprise the relevant d slow degrees of freedom. In equilibrium, this molecule feels 
a potential (of mean force) Vo(x). Optical tweezers or a cantilever attached via a linker give 
rise to an additional potential Ve X (x, A). The external control parameter A(r) describes the 
time-dependent motion of the tweezer focus or the base of the cantilever, see Fig. 1. As 
equation of motion, we choose a Langevin description 

where summation over repeated indices is understood throughout the paper. Here V(x, A) = 
Vo(x) + V ex (x, A) is the sum of both potentials. We allow for a non-diagonal mobility /iy(x) 
which can include hydrodynamic interactions, e.g., through an Oseen tensor [45]. The 
stochastic increments Q are modeled as Gaussian white noise with 

(C i (r)C j (r'))=2^)5(r-r'). (2) 

Throughout the article, we measure energies in units of k-gT, which is set to 1. Likewise, 
we use a dimensionless entropy, i.e., we set the Boltzmann constant ks to 1 as well. Un- 
der equilibrium conditions for constant A, the type of correlations (2) guarantees that the 
Boltzmann distribution p(x, A) ~ exp[— V(x, A)] is stationary. It is an essential assumption 
for the theory we will be discussing that these correlations persist despite the fact that for 
a time-dependent protocol A(r) we are no longer in equilibrium. 

The Langevin dynamics can be cast in the form of the first law, i.e., energy conservation 
along a stochastic trajectory [3]. Manipulating the system by changing the external control 
parameter A gives rise to an increment in applied work 

dV 

dw = -7— — dA. (3) 
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FIG. 1: Biomolecule with (slow) degrees of freedom x = (x\, . . . , X5) attached via polymeric linkers 
to a substrate (xo, left end) and a bead (xq, right end) controlled externally by laser tweezers at 
position A(t). The bare potential Vo(x) involves the internal degrees of freedom. The external 
potential can be modeled as V ex (x., A) = V±(xi — xq) + V±(xq — £5) + (k/2)[xQ — A(i)] 2 , where V\(y) 
is the potential for a (semi-flexible) linker with extension y and k is the strength of the optical 
trap. 



This work will either change the internal energy 



, jr dV , dV JX 
dV = —d Xl + — dA 
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or is dissipated as heat 



dg = dw — dV 



dV 

dx. 



■dxi 



(4) 



(5) 



into the thermal environment. Since the heat bath has constant temperature, we can identify 
this exchanged heat with a change in entropy of the medium as 



Sm(r) 



dq 
dr 



dV 

dx. 



■Xi . 



(6) 



This quite natural definition of the entropy change of the medium along each trajectory raises 
the question whether there is a corresponding entropy change of the biomolecule itself. 

Following the route outlined in Ref. [17], we now show that such an entropy of the 
"system" can consistently be defined along each stochastic trajectory x(r) as 

s(t) = -lnp(x(r),r), (7) 

where p(x, r) is the solution of the Fokker-Planck equation for the probability distribution 



d 

d t p{x,r) = -g\7;(x,t) = Q^-Vij 



dV d 
+ 



dxj dxj 



p(x,r). 



(8) 



Upon averaging with p(x, r), this stochastic entropy becomes the non-equilibrium Gibbs or 
Shannon entropy 



S(t) = (s(t)) 



d d x p(x, r) lnp(x, r). 



(9) 
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The advantage of defining such a system entropy is that one can proof quite general theorems 
involving the total entropy change 

As tot = s(t) - s(0) + / drs m (r) (10) 

Jo 

along a stochastic trajectory x(r) of length t. As shown in Appendix A, this total entropy 
change obeys the integral fluctuation theorem 

(exp[-A Stot ]> = 1, (11) 

which implies immediately the second law in the form 

(A Stot > > 0. (12) 

The brackets (• • •) denote the average over infinitely many realizations of the process. More- 
over, for any function of the final coordinates /(x t ) one even has the relation 

(/(*) exp[-A Stot ]> = </(x t )> . (13) 

The relations (11) and (13) are quite universal since they hold for the non-equilibrium 
average (■ ■ •) with any initial distribution p(x, 0), for any trajectory length t, and for any 
driving protocol A(t). 

These relations should be distinguished from both the Jarzynski relation [4, 5] 

(exp[-W d ]) = 1 (14) 

and the relation [7] 

(/(x i )exp[-^ d ]) = (/(x t )) cqiA(t) , (15) 

where W d = W - AF = W - [F(X(t)) - F(A(0))] is the dissipated work involved in the 
non-equilibrium transition between the initial equilibrium state at A(0) with free energy 
F(A(0)) and the final state at A(t) with free energy F(\(t)). In particular, in relation (15) 
the average on the right hand side corresponds to an equilibrium average at the final value 
of the control parameter, whereas in (13) it is the average involving the actual probability 
distribution p(x, t). It is crucial to note that for Eqs. (14) and (15) the initial distribution 
has to be the thermal equilibrium distribution for A(0) whereas in Eqs. (11) and (13) it is 
arbitrary. 

Even though the motivation of this presentation is on biomolecules, it should be clear 
that the mechanically driven case discussed here applies exactly to colloidal particles coupled 
through direct or hydrodynamically induced interactions and driven by time-dependent laser 
traps. For such systems, these theorems show that fluctuation theorems (as well as the 
Jarzynski relation) persist in the presence of hydrodynamic interactions. 



III. CHEMICALLY DRIVEN CASE 

A. Enzyme or protein with internal states 

As a model for a biomolecule driven by chemical forces, we consider a protein with M 
internal states {1,2, M}. Each state n has internal energy E n . Transitions between 
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these states involve some other molecules A a , where a = 1,...,Na labels the different 
chemical species. We assume that the chemical potentials, i.e., the concentrations c a of 
these molecules are controlled or clamped externally. A transition from state n to state m 
implies the reaction 

£ rTK + n ^ m + V C*4«. (16) 

a a 

Here, r™ m , s™ m are the numbers of species A a involved in this transition, see Fig. 2. We 
assume a dilute solution of A a molecules in a solvent (modeled as a heat bath at constant 
temperature). Reaction time constants should thus be much larger than diffusion time 
constants. Hence, mass action law kinetics with respect to the A a molecules is a good 
approximation and the ratio between forward rate w nm and backward rate w mn is given by 



f± Y[(c a y« m - s ™ . (17) 



ran 



a 



Here, we separate the concentration dependence from some "intrinsic" or bare rates 
w® m , w mn . Their ratio can be determined by considering a hypothetical equilibrium con- 
dition for this reaction. In fact, if the reaction took place in equilibrium with concentrations 
c^ q , we would have the detailed balance relation 

% = ^11 (<%) r " m -' T = % = exp (-AG) , (18) 

Wmn w mn a Vn 

where 

AG = -[E n -E m + Y,K m ~ sTWl (19) 

a 

is the equilibrium free energy difference for this reaction and p^ n are the equilibrium prob- 
abilities of states m and n, respectively. The chemical potential for species a quite generally 
reads 

fi a = E a + In c a (20) 

which for equilibrium becomes /i„ q = E a + lnc^ q . Combining this with Eqs. (18) and (19) 
shows that the ratio of the intrinsic rates 



w° 



^eMEn-E m + J2(r-a m -sT)Ea] (21) 



involves only the energy-terms and is independent of concentrations. Eq. (17) for the ratio 
under non-equilibrium conditions then becomes 



i n V!mt = En - E m + Y,K m - CK = - AE + wZ m . (22) 

w. z — ' 



The right hand side corresponds to the difference between applied chemical work 

5>r - s T)^ a (23) 



w nm 



chcm 



(since every transformed A a molecule gives rise to a chemical work fi a ) and the difference 
in internal energy AE. For the first law to hold for this transition, we then have to identify 
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FIG. 2: Protein or enzyme with internal states. A forward transition (left) from n to m involves 
the chemical reaction A\ + n — ► m + A2 + ^3 and similarly for the backward reaction (right). The 
rates w^ im and w^ n are the (not concentration-dependent) bare rates. 



the left hand side of Eq. (22) with the heat delivered to the medium, i.e. with the change 
in entropy of the medium 

ln ^n =As „ m _ (24) 

We now show that this identification between the ratio of the forward rate and the 
backward rate with the heat exchanged in this step and hence the change in entropy of the 
medium (arising here from an interpretation of a single reaction step in terms of the first 
law) fits into the general scheme of entropy production in stochastic dynamics introduced 
in Ref. [17]. 



B. Entropy production in stochastic network dynamics 

We briefly recall the essential relations of Ref. [17] where entropy production was defined 
quite generally for a Markovian dynamics on a discrete set of states {n}. Let a transition 
between discrete states n and m occur with a rate w nm (X), which depends on an externally 
controlled time-dependent parameter A(r). The master equation for the time-dependent 
probability p n {i~) then reads 

d T p n (r) = ^2[w mn {X)p m (r) - w nm (X)p n (T)]. (25) 

For any fixed A, there is a steady state p s n (X) [19]. 

A stochastic trajectory n{r) starts at n and jumps at times tj from nj to n+ ending up 
at n t . As entropy along this trajectory, we have defined 

s(r) = -In p„( r )(r), (26) 

where p n ( T )(j) is the solution p n {r) of the master equation (25) for a given initial distribution 
p n {0) taken along the specific trajectory n{r). The rate of entropy flow into the medium is 
defined as 

s m (r) = 5 ( r - T i) ln = E 6 ( T ~ Tj)&s n J nt , (27) 
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which leads to a change in the medium entropy along a trajectory of length t as 



As m = I drs m (r). (28) 



o 



The total entropy change 



As tot = s(t)- s(0) + As m = V In + V In (29) 



then obeys an integral fluctuation theorem 

(exp[-As tot ]) = 1, (30) 

which implies the second law like statement 

(As tot ) > 0. (31) 

Likewise, one has in complete analogy to the mechanically driven case discussed above the 
extension 

(/(n t )exp[-A Stot ]) = (/(n t )), (32) 

where f{n t ) is any function of the final state. 

These results hold for the non-equilibrium average with arbitrary initial state, arbitrary 
time-dependent rates w nm (\) caused, e.g., by time-dependent concentrations c a (X), and any 
length t of trajectories. 

Even though the entropy definition for the system (26) and the medium (27) have been 
given in Ref . [1 7] purely formally (or at most in analogy with the mechanically driven case) , 
this definition of the change in entropy of the medium (28) corresponds exactly to the one 
found in (24) for our biomolecular example derived on the basis of the kinetics together 
with the first law formulation along a trajectory. Crucial for this agreement, however, is 
the persistence of the relation (21) for the intrinsic rates in a non-equilibrium situation. In 
fact, this persistence corresponds to maintaining the correlations (2) in non-equilibrium in 
the mechanically driven case. 



C. Several molecules or equivalent internal states: Role of "degeneracy" 

The definitions (26) and (27) for system entropy and entropy change of the medium are 
correct and consistent with the simple assumptions for the kinetics if n and m label single 
states. An important modification arises if several states are lumped into one label n. 

As an example, consider the case of N identical but spatially separable and hence in prin- 
ciple distinguishable molecules of the type discussed above each involved in reactions (16). 
If we can resolve only the numbers n = (n\, . . . ,um) of molecules which are in a particular 
state but cannot distinguish which of the n n equivalent molecules undergoes the transition 
from n to m, the state space can now be labeled by n with the constraint 5Z i=1 n i = N. 
Likewise, we could assume we have N equivalent reaction sites lined up consecutively along 
a multi-domain protein where each site could be in any of the M states, see Fig. 3. 

We now denote the rate for a transition from n to n' with 

n'i — Ui — 5 in + 5 im (33) 
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FIG. 3: Sketch of a multi-domain protein with N equivalent consecutive "reaction sites", each 
involving M (here 3) internal states. The number of sites which are in the internal state m is n m 
(here 3). 



by W nm (n) and the corresponding backward rate as W mn (n'). Mass action law kinetics 
implies 

W nm (n) _ w nm n n ^ 
W mn {ri) w mn (n m + 1) 

since the forward rate is enhanced by the factor n n which counts the number of molecules in 
the state n. Likewise, for the corresponding backward transition, any of the (then) n m + 1 
molecules in state m can jump. If one forward reaction takes place, the entropy change of 
the medium As™ is still given by 

As™' = E n - E m + (r-r - = In — , (35) 

since the first law for a single reaction event remains the same as above. On the other hand, 
by naive application of the general expression (24) as 

Sm - ln W mn (n')~ m + n m + l (36) 

one would obtain an additional term \n[n n /(n m + 1)]. 

The solution of this apparent inconsistency requires an analysis of the entropy defini- 
tion (26) in the case of degeneracy. In our example, the state n carries a degeneracy 

I!-:' (37) 

We now define the stochastic entropy of the state n not by (26) but rather by 

s(r) = -\np n(T) (T) + s° n{T) (38) 

with the "intrinsic" entropy 

s° n = \ng n (39) 

determined by the degeneracy. For a single transition n to n' at time r, the system entropy 
then changes according to 

As nn ' = In ^4 + ^ ^ = In ^4 + ^ (40) 
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If we use this modified definition of system entropy change (40) and the thermodynamically 
correct change in medium entropy (35), the total entropy production in a single step 



A „nn 
*-* d tot 



As 1 



As nn 

m 



hi 



Pn(r) 
Pn'(r) 



111 



n 



W„ 
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(41) 



has the form of the right hand side of Eq. (29). Hence, the fluctuation theorems (30) and (32) 
even hold in the case of a degenerate state space. 

Generalizing and summarizing this procedure, we modify the expression developed in 
Ref. [17] for the change of the medium entropy as 



T - Tn 



hi 



W n-n+ 

l S n,+ — S n 7 - 
W„+„- 3 3 



(42) 



where the additional term in round brackets compensates for each jump the change in the 
degeneracy factor. In the example discussed above, we now get for the contribution of this 
transition to the change in medium entropy 



Asl 



In 



n 



W„ 



n' 



In* 

9n' 



hi 



w, 



W,, 



(43) 



which is indeed the thermodynamically correct expression. Hence, the modified defini- 
tions (38) and (42) for system and medium entropy change in the presence of degeneracy 
are not only consistent with a first law-like energy conservation but also obey the fluctuation 
theorems. While we have identified the intrinsic entropy with the degeneracy, it is tempting 
to speculate that even for other sources of intrinsic entropy the definitions (38) and (42) 
remain meaningful. 



D. Detailed fluctuation theorem in the steady state 

The reaction network discussed above allows also for a genuine non-equilibrium steady 
state. Necessary for such a state are at least three internal states in order to have at least 
one cycle in the network, i.e. two essentially different reaction paths leading to the same 
final state. A non-equilibrium steady state can be obtained if it is possible to adjust the 
concentrations {c a } such that a net flux in the species A a occurs. Hence, the stationary 
state violates the detailed balance condition p s n w nm = p s m w mn . For such non-equilibrium 
steady states a detailed fluctuation theorem 

p(-Astot) = exp[-As tot ]p(As tot ) (44) 

holds with the present entropy definition for any length of the trajectory [17] thus extending 
previous results valid in the long-time limit [46-50]. 



IV. SUMMARIZING PERSPECTIVES 



The thermodynamically consistent description of non-equilibrium processes of small sys- 
tems developed in this paper paradigmatically relies on two central concepts. First, we 
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need a first-law like energy balance along the stochastic trajectory. While its form is pretty 
obvious in the mechanical case, it is less straightforward in the chemical case where it in- 
volves identifying the dissipated heat as the ratio of the forward and backward rate (up to 
a possible degeneracy correction). Second, the non-equilibrium dynamics has to be formu- 
lated in such a way that if it is restricted to the equilibrium concentrations it obeys detailed 
balance with the appropriate equilibrium distribution. This condition does not determine 
the non-equilibrium dynamics uniquely. Still, the present choice for the rates both in the 
mechanical and in the chemical case seems to be the "minimal" extension of the equilibrium 
rates. In fact, one could call such a dynamics an isothermal non- equilibrium dynamics since 
the notion of temperature of the surrounding heat bath still makes sense and serves to relate 
exchanged heat (occurring in the first law) with an entropy change of the medium (enter- 
ing the second law). For this type of dynamics, entropy along a stochastic trajectory can 
consistently be defined such that (i) it reduces upon averaging to the usual non-equilibrium 
ensemble formulation; and (ii) together with the identification of the entropy change of the 
medium the total entropy change obeys exact relations from which a second law for the 
average follows trivially. 

Combining the chemically driven with the mechanically driven case discussed here sep- 
arately is straightforward. Along this line, one could then apply our concepts to models 
previously introduced to describe such coupled systems like in Refs. [51, 52] or the motor 
models mentioned in the introduction. Likewise, the chemically driven case discussed here for 
one (or several identical) reaction sites can be extended to a thermodynamically consistent 
theory of any small-scale biochemical reaction network as will be discussed elsewhere [53]. 

The theoretical framework developed in this paper is quite general. Leaving the appeal of 
exact relations aside, its significance for any specific system will depend on working out the 
particular details. Of special interest seem to be the distribution for the entropy changes of 
system, medium and their sum. Presumably only little can be said for these distribution in 
general since even for simple driven non-biological two-level systems these distributions can 
exhibit a quite rich structure [54]. For a simple three-state model of the rotary motor in the 
steady state, the exact distribution of the entropy change is available through mapping to 
an asymmetric random walk [27]. Numerical analysis of more sophisticated models should 
finally provide us with a better understanding of how entropy changes on the stochastic level 
look like beyond the exact constraints developed in this paper. Finally, it will be exciting to 
see when and how these elements of a non-equilibrium thermodynamics will be integrated 
to a consistent and comprehensive theory of the physics of the cell. 

APPENDIX A: PROOF OF INTEGRAL FLUCTUATION THEOREMS 

In this appendix we show how to extend proofs [7, 17, 50] of integral fluctuation relations 
based on time-reversal to many degrees of freedom involving hydrodynamic interactions. The 
integral fluctuation theorem for the total entropy production (11), the Jarzynski relation, 
and the more general relation (13) then all derive from one master formula, which has been 
given before for the one-dimensional case in Ref. [17]. 

Since the thermal noise 0( r ) m Eq. (1) is modeled as Gaussian noise, the probability for 
a noise trajectory is P[£(r)] = A/"exp{— A[£(r)]} with "action" 

A[C(r)] = ijTdT J\t' G(r)tfy 1 (r-T%-(T'), (Al) 
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correlation matrix Kij(r — T ! ) = (O(t)Q(t')) , and normalization Af. We make the transition 
from the noise history £(r) to the trajectory x(r) given the initial state Xo by inserting the 
Langevin equation (1) 



dV 

&i = -/%(x) — (x, A(r)) + Q = r) + & 



(A2) 



(A3) 



The change of variables from £(t) to x(r) also leads to a Jacobian J[x(r)] in the trajectory 
weight. The Langevin equation discretized into N steps takes the form 



along with the noise correlation (2) into Eq. (Al), leading to 

1 /"* 



[ <(x a )+< -l (x a-l )]+C a 



(A4) 



where the upper Greek indices represent discrete time and e is a small time step. This 
discretization corresponds to Stratonovich's scheme. The Jacobian matrix resulting from 
the change of variables is 

T a(3 _ 9Ci 



J 



(A5) 



from which we calculate the Jacobian as 



J[x(r)] = limdet J°f . 



(A6) 



In order to see the structure of the Jacobian matrix, we define for a given time index a 



e dvf 



± 



e dv 



exp < =f- 



k /„«i 



2 



(A7) 



'j 



The Jacobian matrix can then be written as matrix of matrices 

+M 1 

-M 1 +M 2 

— M 2 +M 3 

-M 3 +M 4 



(A8) 



WxJV 



from which the determinant immediately follows as 

N 

J[x(r)] = lime-* 4 * JJ det M a . 



(A9) 



a=l 



Using the identity det exp = exptr and after taking the limit e — ► 0, N — ► oo with Ne = t 
we finally arrive at 



J[x(r)] = exp (-± jf* dr £ ^(x(r), r) j 



(A10) 
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The action (A3) along a stochastic trajectory can be split into two contributions 

A s [x(r)|x ] = \J Q dr { ±i ^ 1 ^ + ^T^^}' (A11) 
A a [x(r)|x ] = 1 jTdr jjUi = (A12) 

A = A s + A a , where for the last equality we have used Eq. (6). Under time reversal, i.e., 
under the transformation 

T^t-r = f: A(r) i-> A(f), x^t) h-> 5i(f), ^(r) ^ -^(f) (A13) 

the symmetric part of the action stays invariant, A s = A s , whereas A & = —A a changes sign. 
Since the Jacobian J only involves mobility fi and potential energy V it is invariant under 
time reversal, J = J. For given initial state xo and final state x t = xo, the total trajectory 
weight becomes 

P[x(r)|x ] = Arj[x(r)|x ]exp{-A s [x(r)|x ] - A a [x(r)|x ]} , (A14) 
P[x(f)|x ] = Arj[x(r)|x ]exp{-A s [x(r)|x ]+A a [x(r)|x ]}. (A15) 

In order to prove a general version of the integral fluctuation theorem we combine the 
physical picture of time reversal with a generalization of the actual final distribution p(x f ) 
to an arbitrary normalized initial distribution pi(x ) for time-reversed paths. Normalization 
then implies 

l = ^P[x(f)|x ] Pl (x ), (A16) 

x(r) 

where the summation runs over all trajectories. Inserting the actual initial distribution 
Po( x o) we have the master formula 

^ P[x(f) |xo]pi(xo) /p[x(f)|x ]pi(xo)\ _, r n . , 

^ P[x(r) |x ]po(x ) \ P[x(r) |x ]p (x ) / 

with 

R = In P[x(T)|Xo]Po(Xo) = - In * + A Sm . (A18) 
P[x(f)|x ] Pl (x ) 

Replacement of ^ s by is admissible since it does not matter how we denote the sum- 
mation variable when we sum over all trajectories. 

For the proof of Eq. (11), we choose with pi(x) = p(x,t) the actual probability distri- 
bution at the end of the trajectory. With po( x ) the distribution of the initial state, the 
ratio 

R = As + As m = As tot (A19) 
becomes the total change of entropy. If we choose the normalized function 

(A20) 
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with an arbitrary function /(x), where the average in the denominator implies the distribu- 
tion p(x, t), the ratio becomes 

R = As tot -\nJP-, (A21) 
u( x )> 

leading to Eq. (13). Finally, if one chooses pi(x) = p eq (x,\(t)), one obtains the Jarzynski 
relation (14) and analogously the general relation (15). 
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